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Abstract 

We study average-case complexity of branch-and-bound for MAX independent 
SET in random graphs under the Q{n,p) distribution. In this model every pair {u,v) 
of vertices belongs to E with probability p independently on the existence of any 
other edge. We make a precise case analysis, providing phase transitions between 
subexponential and exponential complexities depending on the probability p of the 
random model. 


1 Introduction 

Given a graph G{V,E), the MAX INDEPENDENT SET problem consists of determining a 
maximum-size subset V' of V such that, for any {vi,Vj) £ V x V', {vi,Vj) ^ E. MAX 
INDEPENDENT SET Is One of the most known NP-hard problems (among the 21 ones of 
Karp’s list m) and furthermore, among the hardest problems to approximate in polyno¬ 
mial time, since it is inapproximable within approximation ratio n^~^, unless P = NP, for 
any e > 0 [12]. On the other hand, dealing with solution of MAX INDEPENDENT SET by 
moderately exponential algorithms, i.e., algorithms computing an optimal solution within 
provably non-trivial (exponential) running time, a bunch of such algorithms have been de¬ 
veloped during the last ten years, leading to complexities whose the basis of the exponential 
is now below 1.2, around 1.19 HD. 

The goal of this paper is to study average complexity of branch-and-bound for MAX 
INDEPENDENT SET in random graphs. Although mathematical tools for average-case anal¬ 
ysis of algorithms exist since many years (to our knowledge, |B] was the first book on these 
tools and |3] the most recent one; in the meanwhile and after 2008 decades of papers have 
handled this topic), there are quite a few of results in average-case complexity of exact 
algorithms for NP-hard problems. 

*-“Ahe work has been performed while author was with CEREMADE, Universite Paris-Dauphine and 
CNRS UMR 7534 
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For instance, branch-&-bound is perhaps the most popular and widely known technique 
for solving NP-hard problems. But, despite its popularity, no systematic study for obtain¬ 
ing non-trivial upper-bounds for the complexity of the this method have been conducted 
until now, neither in the worst-case, nor in the average-case complexity framework. This 
is our objective in this paper. 

Our contribution. We study average complexity of branch-&:-bound in random graphs 
under the Q{n,p) random model [2]. We make a precise case analysis, providing phase 
transitions between subexponential and exponential complexities depending on the proba¬ 
bility p of the model. Our study concerns, two versions of branch-&:-bound: the simplified 
one that consists of a simple exhaustive search, and a refined one where nodes of the search 
tree are provided with an evaluation function indicating, informally, for vertex v, the best 
independent set that can be hoped in a leaf of the subtree rooted at v. 

2 Preliminaries 

Branch-and-bound algorithms are among the most common and popular strategies in com¬ 
binatorial optimization for solving NP-hard problems used since the origins of combina¬ 
torial optimization. For a graph problem whose solutions are subsets of the vertex-set of 
the input-graph (this is the case of MAX INDEPENDENT set), a standard branch-&-bound 
implementation consists of subsequently handling vertices one by one and of examining 
two configurations: one where the vertex at hand is part of the solution and another one 
when the vertex is not part. In this way, branch-&-bound builds a fictitious binary tree, 
called search-tree, internal nodes of which can be seen as partial solutions that will be 
expanded to global ones at the leaves of the tree. In other words, suppose that vertices are 
handled in the order to Vn- Then, level i of the tree, corresponds to vertex Vi and the 
nodes of level i correspond to all possible solutions that can be built if one takes, or does 
not take, Vi under any feasible configuration for the vertices vi to Uj_i. So, any partial 
solution at level i will be decomposed into two subsets: those containing vertex Ui+i and 
those that do not contain it. Search tree is pruned on an internal node t when either 
the partial solution represented by t is infeasible, or no hope exists that expansion of this 
solution will lead to an optimal solution for the whole problem. This can be done by pro¬ 
viding internal nodes with an evaluation function (called evaluation), that characterizes 
the “potential” of the corresponding partial solutions (for this reason, in what follows we 
will use the term potential instead of evaluation). Evaluation for node t gives a bound on 
the value of the best leaf of the subtree rooted at t (recall that leaves of the search tree 
correspond to solutions for the whole instance). For a maximization (resp., minimization) 
problem, the potential is an upper (resp., lower) bound of this value. The branch-&-bound 
tree is then pruned on some node when either the partial solution there, is not feasible, or 
the evaluation of the node is smaller (resp., greater) than the value of an already known 
solution. For more details about branch-&:-bound, the interested reader can be referred 
to [9]. 

The goal of the paper is to study the average complexity of branch-(fe-bound in random 
graphs for MAX INDEPENDENT SET. Two main random graph models have been studied 
in the literature, models Q{n,p) (also called random binomial model) and Q{n,m) (also 
called uniform random graph model) [2]. In model Q[n,p), every pair {u,v) of vertices 
belongs to E with probability p (i.e., P((u, u) (z E) = p, V(tt,u) (z V x V), independently 
on the existence of any other edge in G. In model Q{n,m), any graph G on n vertices 
with m edges has the same occurrence-probability, in other words, \IG'{V,E'), such that 
\E'\ = m, P(G = G') = 
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We deal of two versions of branch-fe-bound. The first one is the exhaustive search 
method. It can be seen as a branch-&:-bound where the search-tree is pruned only on 
branches rooted at nodes that correspond to infeasible partial solutions. In the second 
version, nodes of the search-tree are provided with an evaluation function that, as described 
above, is an upper bound on the best solution that will be built when the node is completely 
unfolded. For MAX INDEPENDENT SET a simple evaluation for a node t of the branch-&:- 
bound tree is function u{S) = jS*! -|- [n —(.{€)), where S denotes the partial solution already 
constructed at a node t of the search-tree, n denotes the order of the input-graph and ^[t) 
is the level of t in the tree. Recall that at level the branch-&-bound algorithm has 
handled i vertices of G. Function u{S), also called “evaluation of S'”, simply expresses the 
fact that if S is the partial independent set built when handling some node t, i{t) vertices 
of G have been fixed. The ideal solution one can hope from t is the one that includes in S 
the whole set of the n — i{t) unfixed vertices of G. Recall that the evaluation of a leaf 
(since infeasible subtrees have already been discarded) is the size of the independent set 
corresponding to this leaf. 

Close to the problematic of this paper is the one by [T], where a very nice analysis of 
the exhaustive search for MAX INDEPENDENT SET is done, and phase transitions between 
exponential, subexponential, and polynomial average-case complexities under the Q{n,p) 
model are given. The main result there, is an asymptotic upper bound on the average run¬ 
ning time (denoted by of the exhaustive search when applied on Q{n,p) random graphs 
(formula (1.4) in |T]). It is shown that when p ^ pn becomes subexponential. 

Our results. Dealing with exhaustive search, we first generalize the the result by [I] 
showing that this algorithm runs in subexponential average time whenever n ■ p oo. 
Then we show that, when n - p is a fixed constant k, the average complexity of exhaustive 
search remains exponential and in this case we give explicit upper and lower bounds for 
this complexity and show that both of them tend to 1, when k ^ oo. More importantly, 
we study average complexity of a “real” branch-&-bound method, where potentials are 
associated with the nodes of the search-tree. In this case we show the following: 

• average complexity of branch-&:-bound is subexponential as far as p ^ ^/n for any 
fixed constant k; this means, roughly, that branch-(fe-bound remains subexponential 
for both large and very small values of p and constitutes a major difference of the 
method with respect to the simple exhaustive search algorithm; 

• on the other hand, if p = ^/n, we show that the branch-&:-bound remains exponential 
in average; for this case, we prove that its average running time is bounded above 
by 0(1.867^). 

Notations. For the rest of the paper, T(n,p) will denote the average complexity of branch- 
&-bound in a binomial random graph G{V, E) with parameters {n,p); E[^S'(G)] will denote 
the expectation of the number of independent sets in a binomial random graph G; P{t,i) 
the partial solution formed by vertices in the set {ui,... ,Uj} on node t of the branch-&:- 
bound-tree (recall that vertices are handled in the order vi,V 2 , ■ ■ ■ ,Vn)', Gt will denote the 
graph G[{ui,..., Vi}] (induced by the vertex-set {ui,..., Uj}); finally, u{S) will denote the 
potential of a partial solution 5; if S' = P{t,i), then u{S) = |R(S)| + n — i. 
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3 Exhaustive search: pruning by infeasibility 


3.1 Upper bounds for T(n,p) 

Consider a random (n,p)-binomial graph G. By definition of the (re,p)-binomial random 
model, the probability that a set of k vertices is an independent set of G is equal to 
(1 — p)b); henceforth: 

E[#S’(G')] = ^ Q(1 -p)(2) ^ nrnax|Q(l -p)(2)| (1) 

Note that the number of independent sets in the subgraph induced by the k first hxed 
vertices is strictly greater than the number of independent sets induced in the k — 1 first 
such vertices (since the Uth vertex is an independent set by itself); so: 


T(n,p) ^ n ■ E[#S'(G)] = (1 — ^ v? rrmx | (1 — p)^'^ | (2) 

Using Stirling’s formula, by some very elementary algebra, the following holds for the last 
term of (l2|): 


Lemma 1. If p is a fixed constant, then T{n,p) is subexponential with n and bounded 
above by 0(n*“"'). 

Proof. Note that (en/*)* • (1 - ^ gi(lnn)+ln(l-p)i>^ 

derivative of function f{i) = i(lnn) + ln(l — pfi'^ is decreasing with i and admits a 
maximum when i = go, einn+in(i-p)(*/2) ^ n'"y(_2in(i-p)). Since p is 

supposed to be fixed, —21n(l —p') is a fixed constant. So, combination of ([2]) and ([3]) leads 
to T(n,p) = as claimed. | 

Lemma 2. When p = 4>{n)jn for some function such that 4>{n) = o{n), ^ oo when 

n oo, T{n,p) is subexponential with n and satisfies T{n,p) = Q(^Qn-(( 2 in,i,(n)+in <i>(n))/ 2 ^{n))\^^ 

• 2 

Proof. Revisit function f{i) = f Inn + ln(l — Its derivative is f'{i) = Inn — Inf + 

f ln(l — p). When p —>■ 0, ln(l — p) = —p + o(p); so, /'(f) = ln(’^/j) — fp + ipe{p), with 
e(p) —>■ 0. Function / being convex, its maximum is attained when /'(f) = 0, i.e., when: 


Inn — Inf — fp = fpe(p) =i> Inn = In 


n = fe*P(i+<P)) 


pn = = fe'^ +pe(p) 


(n — e(p)) = fe*^ 


z = 


VF[p(n — e(p))] 


P 


where W{x) denotes Lampert’s function defined by W{x) = xe^^^\ So, f = W{pn)jp and 
(")(1 — p)^^) ^ g( 2 w(np)+iv (np))/ 2 p Q^^). Sincc p = <f>(»i)/n, usiug ([2]), we have: 

2W(tl>(n)) + W^ (4>(n)) 2 ln(<Z(n)) + ln^ (<Z(n)) 

e 2<Z{n) ^ g 2cZ{n) - y Q 


and in this case T(n,p) is as claimed. | 
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Lemma 3. When p = ^/n, for a fixed constant k, T(n,p) is exponential in n. 

Proof. From the discussion in the proof of Lemma [21 T{n,p) = ("p)/ 2 p)^^ 

and for p = ^/n, this gives T{n,p) = W/ 2 k)^^ with g{k) = ‘^W{k)+w^{k)l 2 k 

being constant when k is constant. | 

Note, furthermore, that function g{k) = 2 W(A:)+iy^(fc)/ 2 fc decreases with k. For instance, 
5(1.25) = 1.995 and 5(6.15) = 1.5. 

Lemmata [H [2] and [3] derive the following theorem. 

Theorem 1. The average running time of exhaustive search for MAX INDEPENDENT SET 
when running in (n,p)-binomial random graph G of order n is: 

1. subexponential whenp is constant, orp = <i>W)ln for some function such that (j){n) = 
o{n), with (/) —7> oo when n —>■ oo; 

2. exponential for p = ^/n, if k is a fixed constant. 


3.2 Lower bounds 


Recall that any feasible independent set can be associated with a leaf of the branching 
tree built by the the branch-&:-bound-algorithm. In other words, any such set have been 
explored by the algorithm. Thus, T{n,p) E[^S'(G)]. Revisit ([1]); when p • n —)■ 0, we 
have: 

^^^(1 -p)( 2 ) ^ ^ gi(lnn-lni)+(‘) In(l-p) ^ ^i{lnn-lni)-p{f) 


The maximum value for Q is reached when d[iilnn-lni))-p(^f)ygi = Q, i.e., when: 


n 


p 


In w —I—p-i-\--=0^i = 


IT(e2 ^np) 


p 


In this case: 





P o P 
2W(e^ np) + W’'^(e^ np) 

e ^ 


2W(e~^np) + W^(e~^np) 

e 2 p 


2W(e ^np) + W^(e ^ np) 

and T(n,p) ^ n • e . 

On the other hand, when p = ^jn, A; € M: 


( \ P _1 o P —1 

77 \ (i\ 2W(e'2’ np)+W‘^(e'^ np) 

.](l-p)( 2 ) e ^ 

2W(e~^np) + W^(e~^np) 2W(e~^ k) + W^ (e~^ k) 

= e 2 p = e 2 k (5) 


Function f(k) in ([2]) decreases with k and /(O) —>■ So, for p = ^/n, T{n,p) e"/'". 


4 Associating evaluations with the nodes of the branch-and- 
bound tree 

In this section we analyze the average complexity of a branch-&:-bound algorithm with 
potentials on the nodes of the search tree and following a best-first rule. This rule implies 
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that the node further developed is that of the largest potential (evaluation). Observe that 
the root of the branch-&:-bound tree has potential n and that any “child” Pq of a partial 
solution P has u{Pq) ^ uiP)- Hence, if we have a partial solution Pj+i handled at step 
i + 1 of the algorithm, then Pj+i is either a partial solution already available in step i 
(thus with M(Pj_|_i) ^ u{Pi)), or a child of Pi (the solution handled at step i). Let S* be 
the hrst global solution built by the method; obviously u{S*) = |S'*|. Then, any partial 
solution non-handled yet have some potential that is at most jS**! (otherwise they would 
have been handled before). So, S* is a maximum independent set and any other branch of 
the search-tree will be pruned. 

So, during the unravelling of the algorithm, a partial solution P{t, i) at node t is 
expanded only if its vertices are independent and its potential is at least equal to the 
cardinality of S*. Thus: 


T{n,p) ^ 


E E P {{P{t, i) is an independent set ) fl (n — i -|- \P{t, z)| ^ |*S'*|)) 

i=0 P{t,i)CV{Gi) 


E E P(P(t, i) is an independent set ) 
i=0 p{t,i)cv{Gi) 

■F {n — i + \P{t, i)| ^ IS*! I P{t, i) is an independent set ) 


( 6 ) 


4.1 The basic theorem 

We are ready now to prove the following basic theorem that will be used in what follows. 

Theorem 2. Given a graph G{V,E) with \V\ = n and \E\ = m, the average complexity of 
branch-&-bound with potentials associated with the nodes of the search tree when running 
in G is bounded above by: 


i=0k=0 ^ ^ ^ ^ ^ 

Proof. Revisit ([6]) and observe that, if the size of an independent set S' of G (obviously 
|S| ^ 1 * 5 * 1 ) is aliGady known, it holds that: 


E E F{P{t,i) is an independent set ) 

j=0 P{t,i)CV{Gi) 

■F{n — i + \P{t,i)\ ^ |S*| I P{t,i) is an independent set ) 

n 

F{P{t,i) is an independent set ) 

j=0 P{t,i)CV{Gi) 

■F {n — i + \P{t, i)| ^ \S\ I P{t, i) is an independent set ) 


( 7 ) 


By Turan’s Theorem |10j . any maximal for inclusion independent set of a graph G of 
order n has size at least "■/d+i, where d is the average degree of G. Denoting by m the 
number of edges of G, it holds that m = and, for any k: 


n 


d-\- 1 


^ n — i k ] = P(m^ 


n 


n 


2 ■ {n — i-\- k) 


In order to complete the proof of the theorem, we need the following lemma. 


( 8 ) 
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Lemma 4. For any binomial random graph G(y,E), for any rj € [0, n] and for any 
subset V of V: 

P (m > 7] \ V' independent set ) ^ P(m > t]) 

Proof. [Lemma^ Consider a set V' CV and partition E into subsets E' = {{x,y) G E : 
X ^ V y y ^ V'} and E” = {{x,y) & E : x & V Ay & V'}. Obviously, V' is an independent 
set iff E” = 0 . On the other hand, P(m > rj) = P(|ili'| + \E"\ > rf). So: 


P(|£;'| + \E''\ > r] I \E''\ = 0) 


¥{{\E'\ + \E"\ >r])n{\E"\ = 0)) 

F{\E"\ = 0) 

p((|^;'| > 77 ) n {\E''\ = 0)) 

F{\E"\ = 0) 

P(|£;'| > r])-F{{\E”\ = 0)) 

P(|£:"| = 0) 

P(|^1>^) (9) 


expression ([9]) holding because, E' and E” are independent (edges in E are Bernoulli i.i.d. 
variables). 

To conclude, it suffices to take into account that \E'\ follows a binomial law: 


B 





whereas m follows a binomial law: 



We so have: 


P (|-E'| >77) ^ P(7TT, > rf) P(77r > 77) ^ P (ttt. > 77 I W independent set ) 

The proof of Lemma U] is now completed. | 

In order to complete the proof of the theorem, it suffices to put together ([6]), ([8]) and 
Lemma m | 

In what follows, we separate the possible values of p in the following three categories: 


• n X p ^ 00 ; 

• TT X p —0; 

• n X p = k > 0 

In the case of tt x p —00 the exhaustive search is already subexponential, by Item [1] of 
Theorem [TJ Since branch-&-bound with potentials is faster than exhaustive search, this 
result also holds for the former. 


4.2 Average complexity when n x p —)■ 0 

As m follows a binomial law, we will strongly use some concentration inequalities due 
to mm giving exact deviation from the expectation. In what follows, we set 4>{6) = 
{1 + 6) \n{l + 6)-6. 
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Lemma 5. [Chernoff concentration inequality] Suppose Xi,... ,X]\f are Bernoulli i.i.d. 
random variables, set Sn = = EI'S’at]. Then for any 5 > 0 the following 

bound holds: 

Proof. Let b be the parameter of Bernoulli, and recall that p, = pN. For all A > 0, we 
have: 

P {Sn ^ p{l + - 5 )) = P ^ 

We then use the Markov inequality; recall that the Xfs are i.i.d and = l+p(e^ —1). 

We have: 

P(57v ^ p{l + S)) ^ (l +p(e^ - 1))^ ^ g-iv(Ap(i+5)-p(e^-i)) 

— g-M(A(l+5)+(e^-l)) 


where the second inequality comes from the fact that In (l + p{e^ — 1)) ^ p(e^ —1). Finally, 
for the last bound, we set A = ln(l + 6), and we have the result. | 

In what follows, we will use the notation 7 „ to denote a generic function with at most 
polynomial growth. This function may vary from lines to lines. 

If we decompose the complexity by increasing potential of vertex, we have: 

n 

T(n,p) = '^wn{u) 

x=0 

where rt is a potential-value and Wn{u) is the expectation of the number of nodes in the 
search-tree with potential equal to u. In what follows, we shall write pn instead of p to 
underline the fact that p —)•„ 0. It holds that: 


Wr, 


^(«)= Z] 

i=n—u 

Thereby, we can argue that: 


i — {n — u) 


(i—(n — u)\ 


n n 

m ^- 

2u 2 


71^ n 

Wn{u) ^ 2 ”P ( ^ ^ “ 2 


w, 


.(«) < X] 


I — [n — u)J 


( 10 ) 


Remark that m follows a Binomial law of parameter ( 2 ) and pn- We can now decompose 
the complexity T{n,p) in two different sums, with different behaviors. Let Cn G [0,1], we 
can write 

nCn n 

Tn,p = '^Wn{u) + ^ Wn{u) :=T^{n,p)+ T‘^{n,p) 

U=0 u=nCn 


4.2.1 Small potentials 

Set fn = P ' n. Then, for the small potentials the following bound holds. 



Proposition 1. Let (f){5) = (1 + 5) lii(l + 5) — J and set: 


Sn = 

a, = 


/.-i 


2 In 2 

fn 

1 


1 + (1 + Sn) 


Then T^{n,p) has at most polynomial growth. 

Proof. Revisit ([TT]) and observe that in the term dealing with T^(n,p), u is less than n-Cn', 
hence, using COD, we have: 


T^(n,p) ^ 7n2’"P ^ - 1^^ (11) 

Furthermore, by the definition of Cn we have: 

*■ ("' > f (i ■^ (3*’" 

Observe that E[m] = { 2 )Pn, so: 

T^(n,p) < 7n2”P (m ^ E[m] (1 + Jn)) 

We are now able to apply Chernoff bound getting: 

T\n,p) ^ ^ (/(n)<A(5„)-21n2) 

As 4>{dn) = the result follows. | 

Remark 1. In fact we can chose 6n ^ 4‘~^fn) and as cj) is non decreasing the result 
will be still true, with a better bound on T^(n,p). | 

Remark 2. When pn = ^/n we have: 

^ 

Then, the second term is needed in order to use the concentration Lemma [5l | 


Study of 6n and Cn when /„ —?■ 0. For this case, one can prove the following 
Proposition 2. When fn —>■ 0, then: 

X _ 21n2) ( 1 ^ 
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Proof. Set: 

"<") = “p + 1 } -1 = F(i^ “ 1 

where W{x) is the Lampert function. Then, an easy computation shows that 5n = 

i^(21n2//„). 

Furthermore, when x —)■ 00 , W{x) = Inx + o(lnx). Then: 

TTr \ X — 1 ^ X — 1 ^ X f X \ 

^ ln(^)+o(lnx) Inx \lnxJ 

Since /„ —>■ 0: 

21n2 / 21n2 \ 

as claimed. 

We are going now to compute the asymptotic for Cn- Recall that /„ = o(ln(i//„)). We 
then have: 


Cn — + (1 + ^n){n — 1)^^ ~ (1 + ifn + fn^n){^ + o(l))) 

= [l+(lnr-^^ +oMnr-^^ ]] (1 + 0(1))] 

\ \ \JnJ \ \JnJ 11 I 



and the proof of the proposition is completed. | 


4.2.2 Large potentials, case /n ^ 0 

We now handle the part of T{n,p) dealing with large potentials. In this case the following 
proposition holds. 

Proposition 3. When f{n) 0, T^(n,p) has subexponetial growth. Furthermore, there 
exists a constant h > 0 such that, 


T2(n,p) ^ 7nexp h ■ n ■' In— In ' In — 


1 


-1 


fn 

\ 

Proof. By the definition of T^(n,p), it holds that: 

/ i—(n — u) 


1 


fn 


ii=nCn+l i=n—u 
n n 

< E E 

ti=nCn+l i=n—u 


I — [n — U, 
i 

n — u 


(I - t Y. E 


'U=nC’n+l i=n—u 


i — {n — x) 


Furthermore, the sup in i is reached when i = n, hence: 


n(l-Cn) 


e („!„)= E 

ii=nCn+l ^ ' 'U=0 
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Finally, as far as 1 — Cn < the following bound holds: 

T2(n,p) 

where H{x) = —xlnx — (1 — x) ■ ln(l — x) ([S] lemma 16.19). 

We will now study the asymptotic convergence of T^(n,p). Recall that: 

We set £n = ln(Y/„)“^. Then: 

- (1 - C'n)ln(l - Cn) = - (Sn + O (ffn)) (In (e„) + O (In (6^))) = -£nln£n + o{£nln£n) 
-Cnln{Cn) = -(1 + o(l))ln(l - £n + o{£n)) = ffn + O (e^) 

and finally: 

H (1 Cn) ^ 1 ^ 

It is easy to see now that here exists a constant h > 0 such that H{l — Cn) > —h£n lne„. | 
The discussion above proves the following theorem. 

Theorem 3. The average case complexity of branch-&-hound with potentials on the 
nodes of the serach-tree when running in a random binomial graph is subexponential when 
n X p —>■ 0. 

4.3 Average complexity when n x p = k > 0 



Figure 1: The curve for A. Indeed, A is very close to (4(fc+i)/3) + 1. 


We now handle the case where edge-probabilities are equal to ^^/n, for some A: G M. We 
first prove the following proposition. 

Proposition 4. Let p = ^/n. There exists some A such that, for any u ^ "^/x, Wn{u) is 
polynomial. More precisely, A is the solution of: 

k 

21n2-(A:-hl) + A-h(A-l)ln- -- (12) 

A — i 
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k 

IQ-'^ 

10 "^ 

10"3 

10"2 

10 ^ 

10 ^ 

lO'^ 

7 

1.0004 

1.399 

1.473 

1.589 

1.052 

1.008 

1.001 


Table 1: Extremal values of 7 . 


Or equivalently: 

A = 1 +/c ln2^^ 

4>{z) = {1 + z) lll{l + z) — z 

Proof. Set iV = ”-/2 ■ (n — 1) and K = ("•/ 2 ) ■ (’T-/n — 1) and recall that k = np and that: 

T^{n,p){u) ^ 2’"P(m ^ K) (13) 

Also notice that: 

E(m) = -{n - l)p = - - - 

We restrict ourselves to the case K > E(m); otherwise there is no hope for (|13p to be a 
polynomial bound. This is true whenever u ^ ^/{k+i). 

Now, since we are above the expectation, we get: 

T^{n,p) ^ 2"'n^P (m = K) ^ 2”n^ ~ 

exp I In 2n + AT In —h (N — K) In ( 1-) 

[ n \ n J 

-K - {N - K) In I ^ 

with 

v{u) = 21n2 + - 1 ) InA; - - 1 ) Inn - /c ^1 - - 1 ) In - 1 

+ (^ - 1 ) ln(„ - 1) - („ - ^) In {n-l) + {n- ln(„ - 1) 

= 2 In 2 + (n — 1) In ^1-^ In A; — /c -^ 

= 2 In 2 - 1 + (^^ - l) In /c - A: - 0 - l) In 

= a(a) + o(^) 


n 


u 


n 


-I H-hO — 


n 


w 



with 

k 

p{X) = 21n2 + A — (A: + 1) + (A — 1) In --- 

A — 1 

In other words, wi{u) is polynomial if /i(A) ^ 0. 
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Figure 2: The curve for 7 (fe). 


Note that fi' = ln(fc/(A-i)) which is nonegative according to the hypothesis above, so 
there is exactly one solution to (I12p . Figured] gives an approximation of the curve for A. | 

Theorem 4. If p = ^/n, then the running time is bounded with where (see also 

Figure\^and TableUf): 

• 7 ^ 7(0.47) ^ 1.867; 

• 7 —>■ 1, when k —> 0; 

• 7 —7> 1 when k ^ oo. 

Proof. Fix s = i — n + u. Then: 

n n n n ^ 

T2(n,p)^^ X] Wn{s + n — i) ^ (n + 1)^ max < inax 

ii=0 i=n—u s=0 i=s ^ 


with: 


/• N T * \ 1 * k ■ s'^ 

i{i,s) = sin - + (z - s)ln--— 

s n — s 2n 


= ilni — sins — {i — s) ln(i — s) — 


k ■ s^ 
2n 


It holds that: 


= (1 + Ini) — (1 + ln(i — s)) = In —-— > 0 
oi i — s 


Hence, the maximum is reached when uq = n and thus s = u which leads to: 
T^(n,p) ^ (n + 1)^ max = (n + 1)^ max 


with: 


V’n('w) = nlnn — ulnu — {n — u) ln(n — u) — 


k ■ 

2n 


( 14 ) 


For any given k, the running time is bounded above by: 

7 (A:)"’ < max {min {T^(n,p),T^(n,p)} (u)} ^ max {exp {min {'0„(u), mW»^/ 2 }}} 
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Figure 3: Here, A > 0 and thus j\4 = T^(n,p)(so)- 


We already know that /j is increasing. On the other hand, things are a little bit more 
complicated for ipn- 

,// X 1 N 1 / NX ks , .n — S-. k-s 

i’nis) = -(1 + Ins) + (1 + ln(n - s))-= ln(-)- 

n s n 

This last function is clearly a (decreasing) bijection from ]0, n[ onto M. Thus, there exists 
one single sq such that V’n(so) is a maximum. 

Now, there are two different cases depending on the sign of A = ((bn/n) — (/^/2))(so) as 
illustrated in Figures [3] and |H 



Figure 4: Here, A < 0 and thus M. = T^(n,p)(arg(T^(n,p) = T^(n,p))). 


We now have enough information to compute numerically the value of 

M = max{min{T^(n,p),T^(n,p)}} 
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for any k. The asymptotic bounds directly derive from the following inequalities. When 
/c —)■ oo: 


A4 ^ max {T^(n,p)} ^ max /) 


^ max 

X 


n \ n / 


= gO(l)n 


On the other hand, when k —0 and for uq = {i+k{i+(j>-'^ cot(( 2 /fc)'ln 2 ))) we have: 

Mu<uo ^ max{T^(n,p)} = 

u<uo 


Furthermore: 

Mu>uo ^ max{T^(n,p)} 


U>U0 


u>uo I \n — uj ) u>uo I J 

Thus we can conclude that with the appropriate value for p, the average complexity cannot 
be higher that 1.867"'. | 
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